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(54) Insertion of a logo in a video signal 

(57) When adding logos or other imagery to com- 
pressed digital video bitstreams, logos are inserted into 
only disposable Irames. Since disposable frames are 
never used as references for decoding other frames, the 
logos can be added without adversely affecting the play- 
back of any other frames. Preferably, the compressed 
data for disposable-frame macroblocks corresponding 
to the desired location for logo insertion are extracted 
from the compressed bitstream and replaced by intra- 
en coded logo- inserted data. As a result, logos can be 
inserted into compressed digital video bitstreams with- 
out having to completely decode and re-encode the bit- 
streams, while maintaining the overall quality of the vid- 
eo display. 
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coding techniques with reference to at least one other 
frame. Unlike P frames, however, a B frame is never 
used as a reference for encoding another frame. As 
such : a B frame can be dropped from a video sequence 
without adversely affecting the playback of other 
frames; thus, the name disposable. 
[0012] Video compression algorithms like MPEG en- 
code video frames based on regions of pixels cafled 
blocks and macroblocks. For example, transforms such 
as the DCT transform are typically applied to (8x8) 
blocks of pixel data (i.e., either the pixels themselves or 
motion-compensated inter-frame pixel differences), 
while motion estimation and motion compensation are 
typically applied to (16x16) macroblocks of pixels. In 
motion-compensated inter-frame differencing, for a 
non-zero motion vector, a macroblock in one frame is 
encoded with reference to a (16x16) region of another 
frame that has a location within that frame that is differ- 
ent from the location of the macroblock in the first frame. 
[0013] One advantage to the logo insertion scheme 
of Figure 1 is that changes to each video frame due to 
the insertion of the logo are taken into account when the 
logo-inserted video is compressed by video encoder 
110. For example, changes to the logo areas in both key 
and predicted frames will be taken into account when 
motion estimation and motion -compensated differenc- 
ing are performed during the encoding of both predicted 
and disposable frames. 

[001 4] There are, however, a number of drawbacks to 
this scheme for inserting logos into compressed digital 
video bitstreams. First of all, the scheme requires ex- 
pensive equipment to completely decode and then re- 
encode the video stream. In addition, compression al- 
gorithms such as MPEG are lossy algorithms that rely 
on quantization and other steps that can adversely af- 
fect the quality of the decoded video. As such, the ad- 
ditional decoding and re-encoding steps in this scheme 
will only further diminish the quality of the final decoded 
video display at the customer. 

[001 5] The present invention is di rected to an alterna- 
tive scheme for inserting logos and other imagery into 
compressed digital video bitstreams such as those con- 
forming to an MPEG video compression standard. Ac- 
cording to this scheme, a logo is inserted into only dis- 
posable frames in the compressed bitstream. Since no 
other frames are encoded based on disposable frames, 
the changes to those frames due to the insertion o1 the 
logo will not affect the playback of any other frames in 
the compressed bitstream. Moreover, in preferred em- 
bodiments, only the encoded data corresponding to the 
affected macroblocks in the disposable frame need to 
be processed. As a result, the present invention pro- 
vides a scheme for inserting a logo into a compressed 
digital video bitstream without having to decode com- 
pletely the entire compressed digital video bitstream at 
the local broadcaster. 

[001 6] Figure 2 shows a flow diagram of the process- 
ing involved in inserting logos or other imagery into com- 



pressed digital video bitstreams, according to one em- 
bodiment of the present invention. After selecting the lo- 
go and the desired location for its insertion in the video 
display (step 202 of Figure 2), the blocks and macrob- 
5 locks in the video display that will be affected by the logo 
are identified based on the size of the logo and its de- 
sired location (step 204). The encoded data for only the 
disposable frames in the compressed digital video bit- 
stream that correspond to the identified blocks and mac- 
roblocks are then extracted from the bitstream (step 
206) and replaced with corresponding logo-inserted en- 
coded data (step 208), where the logo-inserted encoded 
data corresponds to blocks of intra-encoded pixels rep- 
resenting the logo. 

[0017] Depending on the particular implementation, 
there are different ways of generating the logo-inserted 
encoded data. For example, in some implementations, 
the logo-inserted encoded data is completely independ- 
ent of the corresponding encoded data in the original 
compressed bitstream. In these implementations, the 
logo effectively replaces the corresponding macrob- 
locks in the disposable frames of the original video dis- 
play. In other implementations, the logo is blended with 
the original video data to achieve a more subtle insertion 
of the logo into the video display. This blending can be 
implemented at the pixel level or at the transform coef- 
ficient level. If at the pixel level, then the corresponding 
encoded data from the disposable frames need to be 
decoded all the way to pixels, which may then be blend- 
ed (e.g., by weighted averaging) with pixels correspond- 
ing to the logo to generate blended pixels which are then 
recompressed to generate the logo-inserted encoded 
data. This process may require the application of an in- 
verse (e.g., DCT) transform to recover the pixels from 
the original encoded data as well as the application of 
the forward transform to generate the logo-inserted en- 
coded data from the blended data. If it is desirable to 
avoid the processing required by the application of in- 
verse and forward transforms, in alternative implemen- 
tations, the blending can be applied directly to the trans- 
form coefficients (without having to apply the inverse 
and forward transforms). In any case, the resulting logo- 
inserted encoded data is inserted back into the com- 
pressed bitstream in step 208 in place of the original 
encoded data that was extracted during step 206. 
[0018] If necessary, other adjustments are also made 
to the compressed bitstream (step 210). For example, 
the replacement of the original encoded data with the 
logo-inserted encoded data may affect certain charac- 
teristics of the bitstream, such as byte alignment or bi- 
trate. Moreover, in some cases, some additional blocks 
of the original encoded data may have to be dropped or 
simplified to compensate for insertion of the intra-encod- 
ed logo-inserted data, since intra-encoded blocks tend 
to require more bits to encode than inter-encoded 
blocks. 

[001 9] Under the present invention , if the logo bound- 
aries coincide with macroblock boundaries and if the lo- 
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the compressed digital video bitstream is re- 
ceived by a local broadcaster from a central 
network and the imagery-inserted compressed 
bitstream is broadcast by the local broadcaster 
to its customers. $ 



7. The invention of claim 2, wherein the imagery-in- 
serted encoded data is intra-encoded data. 



8. The invention of claim 1, wherein the imagery cor- 10 
responds to a logo. 

9. The invention of claim 1, wherein the compressed 
digital video bitstream is received by a local broad- 
caster from a central network and the imagery-in- is 
serted compressed bitstream is broadcast by the lo- 
cal broadcaster to its customers. 

10. An apparatus for inserting imagery into a com- 
pressed digital video bitstream, comprising: 20 

(a) means for extracting encoded data from on- 
ly disposable frames in the compressed digital 
video bitstream, wherein the encoded data cor- 
responds to a desired location for the imagery; 2s 
and 

(b) means for replacing the extracted encoded 
data in the compressed digital video bitstream 
with imagery-inserted encoded data corre- 
sponding to the imagery to generate an image- 30 
ry-inserted compressed bitstream. 

11. A computer-readable medium having stored there- 
on a plurality of instructions, the plurality of instruc- 
tions including instructions which, when executed 35 
by a processor, cause the processor to implement 

a method for inserting imagery into a compressed 
digital video bitstream, the method comprising the 
steps of: 

40 

(a) extracting encoded data from only disposa- 
ble frames in the compressed digital video bit- 
stream, wherein the encoded data corresponds 
to a desired location for the imagery; and 

(b) replacing the extracted encoded data in the *s 
compressed digital video bitstream with image- 
ry-inserted encoded data corresponding to the 
imagery to generate an imagery-inserted com- 
pressed bitstream. 
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(57) When adding logos or other imagery to com- 
pressed digital video bitstreams, logos are inserted into 
only disposable frames. Since disposable frames are 
never used as references for decoding other frames, the 
logos can be added without adversely affecting the play- 
back of any other frames. Preferably, the compressed 
data for disposable-frame macroblocks corresponding 
to the desired location for logo insertion are extracted 
from the compressed bitstream and replaced by intra- 
encoded logo-inserted data. As a result, logos can be 
inserted into compressed digital video bitstreams with- 
out having to completely decode and re-encode the bit- 
streams, while maintaining the overall quality of the vid- 
eo display. 
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ABSTRACT : PROBLEM TO BE SOLVED: To obtain an image decoder where work areas to store 
various data such as OSD data are reserved in a memory without sacrificing image 
quality. 



SOLUTION: When a data reduction control section 64 receives a request to reserve 
storage areas for OSD data, the control section 64 aborts macro blocks equivalent to 
prescribed addresses of a display image. An OSD data access section 63 writes the OSD 
data to areas of a frame storage device where the aborted macro blocks have been 
stored. Since the areas equivalent to prescribed addresses of the display image in the 
frame storage device are assigned to the OSD data storage area only when reservation of 
the storage areas for the OSD data is requested, no image quality is deteriorated. 
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ABSTRACT : 



PROBLEM TO BE SOLVED: To provide a image reproduction method in which the 
arithmetic operation of each block in a frame is devised to properly omit it, so as to reduce 
the arithmetic amount and coding and decoding of a bit stream executed at high speed by 
the communication media use coding algorithm, and to provided the image coding method 
and the image coder. 

SOLUTION: First, all blocks that are not referenced from any block in a Frame C are 
detected from among blocks of a Frame B (figure shows only a block bi), based on 
motion vectors mv(C 0 )-mv(C3) resulting from decoding ail motion vectors that reference 
the Frame B to be skipped, an IDCT arithmetic operation to the detected blocks is omitted 
so as to reduce the arithmetic amount. In an example shown in the figure, the IDCT 
arithmetic operation required for four blocks in the Frame B and four blocks in the Frame 
C substantially is reduced to 7 blocks by omitting the IDCT arithmetic operation with 
respect to the block bi . 
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